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^1.  Introduotlon. 

tn  OMlilnr  g  class  of  tvo-person  gcuass  possesslne  the 

follovlx>s  general  oharacterlstlci^ 

(a)  At  the  heglDZilng  of  the  gane,  and  at  Tarlous  stages  of  tha 

geme,  a  chance  meobanlsm  fimilshes  nmhers  and  ^  from  the 
unit  IntexTal  [o»^  to  tho  two  players,  I  euad  II  re¬ 
spectively.  I  knovB  hut  not  y^,  II  knovs  y^  hut  not  x^. 

(h)  Each  player  pays  a  certain  astount  to  start  the  gone,  re¬ 
gardless  o-f  his  ouhsequent  moves . 

(0)  The  game  is  a  many-move  game  of  the  following  type.  I's 
Initial  move,  wbleh  depende  upaa  Is  one  of  a  fixed 
nonber  of  possible  moves,  which  ore  known  to  II.  However 
II  does  not  know  I’s  move. 

(d)  After  I  has  made  the  Initial  move,  II  has  a  choice  o"  a 
finite  number  of  couater-movea,  which  ore  known  to  I.  How¬ 
ever,  I  does  not  know  II 's  reply. 

(e)  i\fter  II  hae  moved,  I  has  again  the  choice  of  a  finite 
nvaaber  of  moves,  known  to  II,  and  so  on.  Tho  Initial 
maneouyerlng  continues  In  this  fashion  for  r.  fixed  number 
of  turns 

(f)  The  flrs1>  phase  having  been- concluded ,  the  chance  mechanism 
"fur^ilbhos  tvo'hew'hmbers  xjj  and  72" 'to  I  and  tl  respectively. 

TMs.lnltlatee  a  second  phase  of  move  and  counter-move. 

(g)  The  game  continues  in  this  way  for  a  fixed  number  of  phases , 

N,  at  tho  end  of  which  there  Is  a  payoff  to  I  of 

K  — ■  r ,  TI  receives  -  K. 

The  prohlem  of  detemlnlng  the  best  possible  mode  of  play  for  each 
player  In  tho  usual  sense  of  maximizing  or  minimizing  the  expectation  is 
one  that  arises  in  many  Important  applications  of  statistics  and  probability 

I 


theory. 
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The  almpleat  oaae  of  this  general  problem  Is  furnished  by  a  class 
of  card  gauss  vfaleh  snbraces  some  vell-lmovn  dlrerslons.  Apart  from  the 
intrinsic  Interest  and  satiation  of  intellectual  curiosity,  the  principal 
merit  in  considering  these  (relatively)  simple  card  games  lies  in  the  fact 
that  these  games  hare  been  played  over  a  considerable  period  of  time  and 
the  experience  of  covtntless  players  has  furnished  a  set  of  heuristic  axioms 
of  play  vhich  is  extremely  usefiil,  as  ve  shall  see  belov;,  in  unraveling  the 
tangled  she  in  of  the  mathematical  problem.  Once  ve  have  solved  a  number  of 
partlctilar  problems,  the  general  pattern  appears  to  emerge.  It  is  in  the 
discovery  of  this  pattern  that  we  feel  lies  our  principal  contribution 

A  first  question  that  arises,  apart  from  the  precise  solution  of 
the  problem,  peirtalns  to  the  form  of  the  solution.  Do  the  players  use 
pure  or  mixed  stmtegies? 

Experience  would  seem  to  indicate  that  a  mixed  strategy  is  required. 

It  was  with  considerable  surprise  that  we  found  that  there  existed  two- 
person  poker  guae's  where  pure  strategies  could  be  used  by  both  players, 
of.  [  ij  •  Since  then,  wo  have  Investigated  many  more  models  of  two- 
psrson  card  games,  and  developed  a  systooiiatic  technique  ^Ich  we  believe 
will  produce  the  solution  whenever  one  exists  in  tenrjj  of  pure  strategies. 
Unfortunately,  we  liav©  not  been  able  to  show  that  in  the  general  game 
described  above  puj^e  strategy  solutions  mxist  exist. 

Ue  were  able  to  show,  cf .  j  IJ  ,  that,  \mder  mild  assumptions, 
any'  mixed  strategy  in  a  game  of  the  type  described  previously  can  be 


approximated  ty  a  pure  strategy.  In  the  sense  that  the  conrespondlng 
sxpeotatlons  vlU  he  arbitrarily  close.  The  reason  for  this  lies  in 
the  fact  that  the  ohance  moves  nay  he  used  as  substitutes  for  mixed 
strategies.  For  a  formal  proof,  we  refer  to  [  1 J 

To  llliistrate  our  procedt:^,  ve  treat  several  simple  models  of 
tvo-person  games.  It  Is  soon  seen  that  a  great  mathematical  slmpll- 
fioatlon  ensues  If  the  garaea  are  made  continuous,  allowing  the  use  of 
integrals  rather  than  sums,  functions  rather  than  sequences. 

Our  methods  are  equalljr  applicable  to  the  problem  of  finding 
equillhrlm- point  solutions,  of  the  Nash  tjrpe,  of  N-person  games  In 
theory.  In  practice,  the  algebraic  difficulty  introduced  by  non-linear 
equations  causes  a  bit  of  grief.  Eovever,  ve  feel  that  Interesting  and 
Important  as  the  equilibrium  point  theory  Is,  It  omits  many  Important 
features  of  an  actual  game  Involving  more  than  two  players  and  for  that 
reason  ve  do  not  apply  It. 

The  plan  of  the  paper  is  as  follows.  In  the  second  section  ve 
discuss  a  game  which  can  be  thotight  of  as  half  of  a  simplified  poker 
game.  The  experience  gained  here  Is  useful  in  discussing  the  bilateral 
gsme.  We  then  treat  in  detail  three  types  of  tvo-person  games,  each 
with  Its  particular  feature  of  Interest.  Sandvlohed  between  le  a  8hoz*t 
dlsciisslon  of  a  game  which  occupies  an  intermediate  position  In  the 
hierarchy. 


V«  eonildwr  f Ivat  •  lanooMt  gpam  plajrvd  aeooviikt  to  tko 

i  , 

foUovlng  nlM.  Thor*  ar*  V.plajtn,  iriwr*  tlM  «xaot  n»‘b«r  la 

iBOUiterial.  If  Nal,  gambling  is  not  possible,  although  a  solitaire 
game  renalna.  If  N  is  vary  large,  several  decV.s  of  ceurdo  may  be  re¬ 
quired.  In  general,  2  <  N  <  10.  In  turn,  each  player  deals  himself 
and  the  other  players  four  cards  each.  Before  play  begins,  each  player 
antes  one,  so  that  there  is  a  sm  of  N  in  the  pot.  Upon  looking  at  his 
cards,  the  first  player  to  the  left  of  the  dealer  has  the  option  of  not 
betting,  whereupon  he  automatically  leaves  his  ante  in  the  pot,  or  of 
betting  tin  amount  f,  1  <  f  <  K,  that  he  can  beat,  Jn  its  suit,  the  next 
card  the  dealer  tuzns  up  from  the  deck.  If  ho  does,  he  wins  f  from  the 
pot,  if  not,  he  contributes  f  to  the  pot.  The  next  player  to  the  left 
has  a  similar  choice,  with  the  difference  that  the  new  upper  limit  will 
he  If+f  if  the  flirst  player  has  lost.  Whenever  the  pot  falls  beneath  K  in 
site,  each  player  antes  one. 

Each  player  sees  at  most  one  card  from  any  other  player's  hand,  for 
the  rules  demand  that  the  winning  player  shew  only  the  necessary  najor- 
Islng  card,  and  that  the  losing  player  throw  his  hand  away  face  down. 

We  shall  in  the  disausslon  below  Ignore  the  additional  information,  in 
most  cases  of  negligible  effect,  >diich  may  be  gained  that  way,  and  the 
fact  that  the  upper  limit  for  individual  wagers  nurvy  Increase  considerably 
above  K,  which  in  actual  play  occurs  alaimlngly  often. 

t 

We  begin  by  considering  the  following  simple  version. 

There  are  two  players,  B,  for  bettor,  and  D  for  dealer.  D  deals  B 
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a  card,  Xi,  0  <  Xi  <1,  and  one  to  hlmaelf,  y^,  0  <  yi  <  1.  Before 
the  betting  begins,  both  players  ante  one.  Upon  receiving  hie  card, 

B  has  the  choice  of  betting  an  amount,  f(xi),  1  <  f(xi)  <  M,  or  of 
folding.  In  which  case  D  automatically  wine  tho  ante.  If  B  bets  f(xi), 
D  has  no  choice  but  to  cover.  If  x  >  y,  B  wins  f(x)  +1,  if  X  <  y,  B 
loeea  f(x)  -f  1. 

Given  the  distributions  of  x  and  y,  the  problem  Is  to  determine 
the  best  possible  mode  of  play  for  B. 

Lot  X  have  the  distribution  function  F(x),  and  y,  tho  distribution 
function  G(y)  whore  F(0)  =  G(0)  =1,  P  dF(i)  *  j  dG(y)  =  1. 

It  la  Intuitively  clear,  and  may  easily  be  shown  rigorously,  that 
since  D  cannot  be  blxiffed  out,  f(x)  must  bo  a  non- decreasing  function 
of  X,  and  hence  if  B  does  not  bet  on  Xi,  he  does  not  bet  on  Xg,  If 

Xi  >  Xa. 

A  consequence  of  this  Is  that  B  folds,  l.e.  drops  out  and  allows  D 
to  win  the  ante,  if  x  <  ai,  where  Is  some  as  yet  undetermined  number 
In  the  unit  Interval,  and  bets  f(x)  If  x  >  ai . 

B*8  expectation  is  given  by 

(1)  EL  =  -  dF  +  f  (l+f(x))h(x,y)dF(x)dG(y), 

X  <  ai  ai  <  X  <  1 

0  <  y  <  1 

where  K(x,y)  is  defined  by 

(2)  K:(x,y)  =  1  If  X  >  y 


-1  otherwise . 
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Ej,  nay  "ba  almpllflad  to 

(3)  f  (l+f(x))  (2G(x)  -l)dP(x)  -  y  dF(x). 

X  >  ai  X  <  ai 

B  must  nov  choosa  and  f(x)  so  that  this  expectation  Is  a 
maximum . 

Let  X  he  a  point  vhere 

o 


(4)  aG(x)  -1  =  0. 

tslnce  G(0)  =0,  /  dG  =  1,  there  la  one  such  point.  The  point  Is 

“'o 

unique  if  dG  >  0.  It  la  clear  that  ax  <  x^,  since  If  ai  >  x^,  we  may 
always  Increase  Eg  hy  decreacing  ai . 

Therefore,  regardless  of  the  value  of  ai,  f(x)  Is  chosen  as 
followB 

(5)  f(x)  =1,  ai  <  X  <  x^ 

=  M,  X  <  X  <  1. 

r  O  —  *~ 

'  The  expectation  nov  takes  the  form 

(6)  2  /  (X(i)-l)dF(x)+(l4i.l)/"j2G(x)-ljdI’(x)-  /  dF{x), 

&x  <  X  <  X  '  X  ^  x  <  ai 

^  —  o  o  — 


ai 


f  (lKJ(x)-l)di’ 
<  ac  <  Xq 


■►(M+l)  f’  (  20  ( x)  - 1)  4F 


1  + 


I  dP 
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Fran  this  it  follows  that  ai  is  chosen  "by  the  condition 

(7)  ai  =  liif  [xj  to(x)  -  1  >  0 j  . 

Collecting  the  previous  results,  B's  "best  strategy  is  determined  by 

(8)  f(x)  -  1,  ai  <  X  < 

= 

vhere 

(9)  (a)  2G(x^_)  -1  =  0, 

(b)  aj.  Is  determined  by  (  ), 

and  B  folds  If  0  <  x  <  ai . 

In  particular,  If  we  assume  that  x  and  y  are  uniformly  distributed 
over  the  unit  lnter\'al,  we  have 

(10)  f(x)  =1,  t  ^  2 

=  M,  I  <  3C  <  1, 

and  B  folds  for  3c  < 

Having  seen  the  pattern  of  a  aolutlon  consider  the  more  complicated 

game; 

"Given  two  players,  B  and  D,  let  B  be  dealt  a  card  Ci  =  (xi,X2»  » 

a  point  in  the  n-dimeiiElonal  unit  region  0  <  x^  <  1,  irtiere  the  distribution 
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function  of  C  Is  known,  amd  D  "be  given  a  card  Ca  =  0  <  s  <  1, 

which  has  prohablllty  of  being  compared  to  In  order  to  determine 
the  outcome.  If  B  and  D  both  ante  one,  and  B  Is  eillowed  to  bet  an  amoimt 
f  =  f(C),  1  <  f  <  M,  winning  (1+f)  if  2  <  x^,  losing  (1-ff)  If  z  >  x^,, 
what  Is  the  boat  possible  mode  of  play  for  B?" 

B's  strategy,  as  before,  will  be  to  fold  if  C  =  (xi,  Xz,  ...,  x^) 
is  within  a  certain  regions,  and  to  bet  If  C  is  outside  this  region.  B's 
expectation  la  easily  written. 


(11) 


f  ri+f(c)j  K(x^,z) 


n 

TT  dF.dG(z) 
1-1  ^ 


f  [l+f(C)}  I  if:  p^(2G(Xj)-l)l  irdS-^CXj) 
4.I-P  (  ^ 


The  notation  Is  as  follows;  I  denotes  the  unit  cube,  CeR  means 
that  C  Is  within  the  region  R,  and  In  what  follows,  AHB  denotes  the 
Intersection  of  the  two  regions  A  and  B. 

To  maximize  Ejj,  it  is  clear  that  wo  should  choose  f(C)  -  M  In  the 
ireglon  3,  belonging  to  I-R,  defined  by 

(12)  F  Pl(aCJ(Xj)  -  1)|  >0, 


I 
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and  f(C)  =  1  In  the  ccmplementary  part  of  I-R.  It  Is  clear  that  it  is 
a  matter  of  indifference  what  the  value  of  f(C)  is  whenever  the  ex¬ 
pression  in  (12)  l3  zero. 


Hence 


n 


(13) 


TT  +  (M+1) 


f 


*1 


p  (2G(X  )-l)^  TT  dF^(Xj) 

V  i  i-1  ^  J 

Ce3^Hl-H) 


2 


/ 


n 


ct(i-s)n(i-p.)- 

It  remains  to  determine  P.  V/rlte 


1=1 


p^(2G(x.)-l)|  TT  dF^(x^) 


(IM 


/  IT  .  y  • 

C»R  Ccl  CeT-P 


r 

j 


=  1  -  -  J 

C4(i-e)  ns  Ct(T-P)r.(x-G) 


Thus 

(15) 


TT  = 


=  -1  + 


‘2  2II  Pi(2G(x  )-l|  i!  dF 

1  1=1 


+  tenas  independent  of  P . 


Pecreaslns  the  region  F.  will  increase  E  until 
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(16) 


n 


1»1 


p,(20(xj  -1) 


Hence  E  la  defined  by 


n 

(17)  2^P  (2G(x.)  -1)  -1  >  0. 

1=1  ^ 


Let  ua  now  consider  the  application  to  Eed  Dog.  Let  us  assume 
that  the  x^  are  unlfomly  distributed,  z  la  unlfonaly  distributed,  and 
Pj^  =  corresponding  to  four  suits.  The  region  where  the  maximum 
should  be  bet  la  deteimlned  by 


(18) 


k 

2  / _  P-G(x.) 

1=1  ^ 


1  >  0, 


and  the  folding  region  by 


4  4 

(19)  1  +  2  p.(2G(x.)  -1)  =  ^  X  -  1  <  0. 

1=1  ^  ^  1-1  ^ 


In  the  actual  game  of  Red  Dog,  Is  a  step  fiinctlon  with  Jump  at 
k  =  1,  2,  12.  F\irthormore  in  order  to  ccmploto  the  discussion 

ve  should  consider  the  case  where  a  hand  le  void  of  one  or  more  suits. 
The  second  point  may  easily  be  taken  care  of  in  the  continuous  oa^e. 

The  first  point  requires  oiily  a  good  deal  of  arithmetic. 

It  la  interesting  to  note  that  the  general  structure  of  the  game 


may  be  detemlned  without  knowledge  of  the  fine  atruct\u*e.  This  observation 
will  be  very  valuable  In  what  follows . 


-11- 

P-160 


In  the  pr^TlooB  saotlooj  v«  bATe  Alsouss«d  th«  atmtAor  to  Ilf 

employed  "by  the  first  player  whenever  the  second  player  la  forced  to 
cover  all  bets.  A  first  extension  of  this  situation  Is  a  game  where 
the  dealer's  strategy  Is  pai^tly  fixed ,  paz^ly  free .  An  example  of  a 
game  of  this  type  la  the  game  of  blackjack:,  or  twenty-one.  A  well- 
known  variation  Is  the  game  of  seven-and-a-half . 

The  game  of  blackjack,  stripped  of  Inessential  minor  features,  Is 
played  as  follows.  A  bridge  deck  is  used  with  the  picture  cards  counted 
as  ten,  an  ace  as  one  or  eleven  at  the  choice  of  the  player,  and  the 
other  cards  retaining  their  nmerlcal  values.  There  are  two  players, 
a  dealer  and  a  bettor.  Each  player  Is  dealt  a  closed  card.  The  first 
player  has  the  choice  of  folding  Immediately,  in  which  case  he  loses  a 
token  amount,  t]ie  ante,  or  of  batting  on  amomt  which  depends  upon  the 
card  he  receives  and  the  allowable  bets.  The  object  of  the  game  is  for 
each  player  to  got  a  total  of  twenty-one  by  drawing  open  cards  from  the 
dock.  If  neither  player  attains  a  total  of  twenty-one,  the  hands  are 
compared,  and  the  hand  with  hi^er  point  total  wins,  with  ties  going  In 
favor  of  the  dealer.  What  prevents  repeated  drawing  Is  the  rule  that  a 
player  automatically  loses  if  his  point  total  ever  exceeds  twenty-one. 

After  B  has  drawn  one  card,  ho  has  the  choice  of  continuing  to  draw, 
"pulling",  or  of  not  pulling,  "sticking".  Once  B  has  concluded  his 
moves,  D  has  the  same  choices.  As  currently  played,  however,  D  is 
compelled  to  pull  If  he  has  fifteen  or  under,  and  must  stick  If  he  has 
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sixteen  or  ovor.^  This  may  be  regarded  ao  cm  anower  to  possible  bluff¬ 
ing  on  B'a  part,  and  ve  shall  see  that  In  the  tvo-person  poker  games  we 
discuss,  exactly  this  method  Is  used  to  counter  bluffing. 

B  bluffs  by  sticking  with  a  low  point  total,  such  as  twelve  or 
thirteen,  hoping  that  D  will  pull  over  twenty- one. 

It  Is  rather  interesting  to  observe  that  In  this  case  experience 
has  dictated  the  use  of  a  pure  strategy  on  the  part  of  the  dealer.  It 
la  easy  to  concoct  various  simplified  models  of  blackjack,  and  in  each 
of  these  models,  pure  strategies  will  be  foimd  to  exist. 


4  U.  A  Simple  Poker  Gaiae. 

We  begin  by  connlderlng  the  game  where  there  are  two  players  A  and 
B,  each  of  whom  receives  a  card,  x  and  y,  respectively,  0  <  x,y  <  1, 
where  for  simplicity  we  assume  that  x  and  y  are  equldlstrlbuted .  Each 
antes  one  before  play  begins.  A  has  the  choice  of  folding  or  of  betting 
an  amount  a  >  0.  B  has  a  choice  of  folding  or  of  seeing  A't  bet. 


I,et  tuj  use  the  following  notation: 


Let  4^,  ^  be  the  characteristic  functions  of  Ap,  and  Ag,  bip,  be  the 

characteristic  functions  of  Bp  eind  Bg. 


It  Is  COTimonly  believed  that  this  policy  is  pursued  to  prevent  the 
dealer  from  using  marked  cards  . 
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Then 


Writing  in  tema  of  characteristic  fimctlons,  this  becomes 

r  ; 

(3)  \  "  y  ^  ^  j  J  '^• 

'■■'^o  'O'  C  J 

■'fierwing  E^  from  A'a  point  of  vlev,  vlth  the  aim  of  maxinlzlng  we  see 
that  for  fixed  ^(1^,  A  chooses  or  ■''or  a  particular  value  of  x, 

depending  upon  the  relation  "between 

(4)  Ii  -  -  1  and  Ic  =  /  +  (a+1)  /  V''^(y)K(x,y) dy. 

'•'o  'o 

Let  \is  now  naite  the  fvmdariental  assumption  that  a  solution  In  terns  of 
pure  strategies  exists.  Under  this  assumpt'on  wo  shall  find  the  form  of 
the  eolution.  It  is  then  easy  to  show  that  vliat  we  t<avo  actually  is  a 
solution. 

At  X  =  0, 


-lu- 

P-168 


(5) 


la  =  y  !f/„dy  -  (a+1)  J  ljJ2(y)dy 


/r  1  n  1 

y  ijipdy  -  (a+1)  1  -  J  >4/pdy  -  -  (a+1)  +  (a+2)  J  f^dy 


Let  us  now,  aas^Tme  firj-t  that  Ii  >  laCO),  so  that  A  always  folds  at 
X  =  0,  and  hence  in  some  neighborhood  of  x  -  0. 

Turning  now  to  E, ,  viewed  from  B’s  vantage,  w©  must  coupare 


(C) 

or 


Ji.  =  dx  and  Js  -  (a+1)  J  E(x,y)dy, 

S\.  -  J  'wiJi  da  =•  (a+1)  ^(»)K(x,y)dx. 


At  y  =  0,  these  are 

(')  J).  =  j  .  ’^2(0)  -  (a+1)  /'  ^jj(x)dx. 

o  1/0 


Consequently,  it  ia  always  true  that  B  folds  In  soae  neighborhood  of  th© 
origin.  Furtheraore,  since  Ji  is  a  constant  and  J2(y)  is  a  laonoton© 
decreasing  function  of  y,  it  is  clear  that  if  B  starts  seeing  A’s  bet 
with  y  =  yi ,  ho  seeo  whenever  he  hae  a  yp  >  y^ . 


(8) 


B: 


^  Folds  ^  Gees 


The  question  arises  as  to  the  dotomlnation  of  b.  Referring  to  (6),  we 


have 
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(9) 


■y  rl 

J2(y)  =  -  (a+l)  /  ^(x)dx  +  (a+1)  /  ^L(x)dx 
o  J  ° 


=  (a+l) 


ry  .  1 

1  -  2  /  '’f  i 

y 

^  Q 


x)di  . 


Therefore  B  only  changes  over  from  folding  to  betting  at  y  If  the 
measvire  of  the  set  upon  which  A  beta  to  the  left  of  y  Is  large  enougli 
to  malre  J2(y)  »  Ji . 

Let  us  now  rottum  to  A  and  see  what  it  Is  that  will  make  him  bet 
In  the  interval  [O,"^  •  We  have,  as  In  (9)> 

/.I 

(10)  I2  =  /  ^dy  +  (a+l)  ,  2  /  jj(y)dy  -  1  . 

•Vo'  (.0 

Hence,  A  only  changes  from  folding  to  betting  at  x  If  the  measure  of 
the  set  upon  which  B  bets  in  0,x  la  large  enough  to  nahe  l2(x)  =  Ii  . 

This  la  clearly  linpossible  In  iO,b  ,  bj  that  If  '  ever  starts  by 

* 

folding  at  0,  he  csntlnuee  folding  up  to  b,  at  least.  But  thlo  Implies 
that  B  has  no  mot  1  vat  on  for  changing  over  at  b.  Continuing  in  this  way, 
we  see  that  the  only  solution  would  be  for  both  to  fold  regardless  of  the 
card  each  receives . 

This  ooeiiis  rather  far-fetched,  and  wo  consequently  investigate  the 
other  two  posslbllltlea;  viz. 


(11) 

a. 

A  always  sees  . 

b. 

At  X  =  0,  it  makoB  no  difference  to  A  whether  he  sees 
or  folds . 
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The  first  alternative  is  again  Improbable,  and  it  is  sensible  to  consider 
the  second  alternative.  Using  (5)>  lit  Implies  the  equation 


(12) 


-1  =  -(a+1)  +  (a+2)  J  i/^pdy, 

^o 


A' a  strategy  must  now  tahe  the  form 

(13)  A:  ,^yold  or  Bet  , - Bet - ^ 

The  reason  why  A  must  bet  in  [b,l]  is  that  B  is  betting  in  [t,lj  , 
so  that  although  =  -1  =  l2(x)  for  0  <  x  <  b,  l2(x)  >  -1  in  jb,lj 
The  measure  of  the  cot  upon  which  A  bets  in  !0,bj  is  deteminod  by  the 
condition  that  at  y  =  t 

(lU)  Ji(b)  =  J2(b) 


f  ^  ^dx  =  (a+1)  f  ^(x)K(z,b)dx 


J  ^dx  +  1-b  =  !'  S^lgdx  =  -(a+l)  j  ^^(x)dx  +  (a+l)  f  dx 

o  o  b 


(a+2)  J  5<g(x)dx  =  a(l-b) 
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/; 

Unfortimately  1  la  still  undetermined.  Taking  A' a  strategy  to  "be 
of  the  fom 

(15)  I - ^ - 1  ,  C  =  (2(a+l)b-a)/)a+2), 

0  C  1 

Is  easily  cceiputod,  referring  to  (2)  and  (15)>  namely 

(16)  E.  -  C  +  h(l-C)  -  (a+1)  (h-C)  (1-b)  . 

r\ 

Maxlnialng  over  "b,  we  find 

(1  )  b  =  a/a+2,  C  =  (a/a+2)'-. 

This  solution  la  valid  for  all  a  >  0,  and  we  see  that  b  has  the  correct 
behavior  as  a  0  or  . 

^  4.  Another  Simple  Model. 

Let  ue  now  consider  the  following  giune  where  we  increase  the  complexity 
by  introducing  2  beta  z^,  z^,  >  i-i-  This  is  the  game  whose  solution 

was  given  In  our  original  note,  1  ]  .  We  now  have  the  following  three 
seta  for  A: 

(1)  "TP  ~  where  A  folds  , 

-  set  whore  A  beta  low,  z^ 

A-t  =  set  where  B  bote  high,  z^, 


f 


-18- 

P-168 


and  the  sets  for  B: 

(2)  Bpj^  =  set  where  B  folds  if  A  nakes  a  low  bet, 

Bp2  =  set  where  B  folds  if  A  mokes  a  hi^  bet, 
Br_  =  set  B  sees  if  A  makes  a  low  bet. 


^GE  =  sot  B  sees  if  A  makes  a  high  bet. 

Then 


/  !  /  dy  +  (Z.-+1) 

I- 


y. 


B. 


1 

K(x,y)dy  I  dx 


+ 


/ 

/ 


l  .  / 

dy  +  / 

(Zl+1) 

/ 

K(x,y) dx 

I.  %  -! 

^GL 

- 

A 

./  dx 

dy  +  / 

(  2.0+1) 

r 

/ 

K(x,y)dx 

L  . 

I  ^SH  i 

1 

Let  us  begin  by  looking  at  E,^  from  B's  point  of  view. 


Sines  B's  decisions 
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From  what  haa  preceded,  we  suspect  that  at  x  =  0,  Ji  =  Jc(0)  =  JaCO) . 
To  avoid  tiresccie  repetition,  we  ahall  not  go  through  the  mathematical 
argument  which  shows  this,  since  we  will  go  Into  detail  in  the  next 
example,  hut  assume  it. 

Thus  A' 3  strategy  is,  ao  far. 


0  bi 


Referring  t  >  B'a  diagram,  we  see  that  at  bi,  betting  low  must  become 
preferable  to  folding  for  A,  since  B  starts  seeing  at  bj.  •  It  Is  reason¬ 
able  to  assume  that  bg  >  hi,  at  first.  We  continually  use  our  experience 
with  the  actual  game  to  reduce  the  nmber  of  possible  cases. 

Ve  see  that  from  bi  to  b^;,  A  must  bet  low 


Bet  low 


Bet  high 
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From  "bs  on  J3  increases,  "but  It  takes  some  set  of  seeing  high  bets  on 
B'8  part  to  catch  up  to  J2»  that  at  only  at  bg,  J2  =  J3,  and  from 
then  on  A  bets  high.  Ja  and  J3  can  intersect  in  only  one  point,  since 
B's  strategy  makes  the  two  curves  straight  lines. 

Ue  now  turn  to  the  determination  of  the  constants,  lie  have  the 
following  constraints: 


(11) 


a.  -it  X  =  0,  Jx  —  J2  —  ds 


b.  At  y  =  bi ,  Ii  =  I2 

c.  At  y  =  b2,  I3  :=•  14 

d .  At  X  ~  bs »  J2  “  *13  • 


There  are  five  equations  for  the  five  unknowns  bi,  b^,  bs,  and  the 
measures  of  the  bet-low  and  bet-high  sets  in  [o,bii 
We  have  then,  using  11a: 


(12)  -1  =  bi  -  (zi+l)(l-bi), 

bi  =  7.i/zi+2, 

-1  =  b2  -  (Zi+l)(l-b2), 
b2  =  Z2  /z2+2 . , 


Using  11b,  we  have  at  y  •-  bi 
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(13)  /  dx  =  (Zi+1)  f  K(x,'bi)dx 


“l  -  "(*i‘*'l)™L  ^  (Ift'l'iO  ^1+1) 


Using  11c,  at  y  =  ^2 


(1*^) 


’iijj  =  -(zi+l)nijj  +  (l-'b3(z2+l)  , 


wheM  Qj^  la  the  measure  of  the  set  where  A  "bets  low,  and  is  the 
measure  of  the  sot  where  A  bets  high. 

Using  lid  at  X  =  bs 


(15) 


f  dy  +  (Zi+1)  ./  K(b3,y)dy  =  /  dy  +  ( Zg+l)  / 

^FL  ®oL  ^FE 


2+1)  /  K(b3,y)dy 

B„„ 


bi  +  (zi+1) 

r,  ^ 

=  b2  +  (Zg+l) 

/■B3 

J  ' 

:  +  /  "  K 

1 

1  bi  ^ 

_ 

>3 

which  reduces  to 


whence 


( ^  1  "^1)  ( “bi -1)  =  b'j  +  (  Z2+I)  ( Pbs -b2“l)  , 


(16)  ^  + 


^  1)2^2  "■  b^Zj^ 


2  2(z2-Zi) 


=  U3 . 
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From  ( l6)  ,  we  have  "bs ,  and  from  ( I5)  and  ( l4)  and  .  We  must  now 

examine  the  values  for  consistency,  that  la,  we  muat  check 

(1*7)  0  <  rv  +  Ely  <  bi,  >  0,  nij^  >  0, 

0  <  bi  <  b2  <  ba . 

Clearly,  from  (12), 

From  (13) 

(18)  := 

(l-ba) (z^+l) 

Without  difficulty  we  find  that  our  solution  is  valid  for  Zs  >  Zi  >  .62, 

where  .62  is  an  approilTRatlon  to  2/c  -  2,  and  c  is  the  smallest  root  of 
3 

-jj-  -  2c^  +  ^c-2  =  0.  We  have  not  Investigated  the  problem  for  Zi  <  .62. 
The  value  of  the  ga/aa  is  easily  found  to  be 

•  I  !  / 

(19)  E  -  j-Ci  +  (2-Ci)(C'.-Ci)‘'  +  2(2-Ca)(o--c0c2  +  (2-C£)c2Ci  /  Ci, 

"  >/ 

whore  Ci  =  2/2+Zi,  -  2/2+Z2. 

b'o.  The  Poker  Game  with  a  Fai  :-e. 

V'e  now  Introduce  one  of  the  characteristic  features  of  actual  poker. 


1  >  b^,  >  bi  >  0. 

(^-bi)(Zi+l) 


the  raise.  We  consider  the  following  model.  A  and  B  are  each  dealt  cards. 
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X  and  y  respectively.  Before  play  'bogina,  "both  players  ante  one.  After 
the  cards  are  dealt,  A  has  the  choice  of  folding,  in  which  case  B  wins 
the  ante,  or  of  "betting  an  emount  a  >  1.  After  A  has  bet,  B  has  the  choice 
of  folding,  of  seeing  A's  bet,  in  which  case  the  hands  &re  compared,  or 
of  raising  an  amount  a,  in  which  case  A  may  either  see  the  raise  or  fold. 

We  shall  uae  the  following  notation: 


(1) 


Ap  =  aet  on  which  A  folds. 

Ag  =  sot  on  which  \  bets,  but  does  not  see  a  raise. 

=  sot  on  which  A  bets  and  sees  a  raise. 

Bp  =  set  on  which  B  folds. 

B^  <=  set  on  which  B  sees  A's  bet,  but  does  not  raise. 
=  set  on  which  B  raises  A's  bet. 


Let  E,  be  A's  expectation.  Then 


(2) 


E,  =  jT  (-l)dx 

‘V 


+  /^  j  /  dy  +{l+e)  K(x,y)dy  -(a+1)  A  dy  dx 


+  /  l  /  <iy+(J-+«)  ,/  i:(x,y)dy  +(2a+l)  /  K(x,y)dy  i  dx 
ft  I  -n  3  U  i 
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dx  +  Z'  dr!  dy  -  X  dx 

4  J  \ 


r 


(1+a)  K(x,y)i)c  +(1-Ki)  /  K(x,y)(ix 


dy 


+  /  I  (2a+l) 


/  K(x,y)dx  -(a+l)  /  dx 

'^G  J 


dy. 


Lot  us  write 


(3) 


E.  =  /  Ti(x)dx  +  J  l2(x)dx  y  l3(x)di 

'V  ^3 


=  /  Ji(yHy  +  /  i2(y)dy  +  /  i3(y)dy 

Bp  Bg 


Me  note  the  following  iramodiate  proportlee  of  the  I's  and  J's 


(4)  (a)  '^■£3  a  monotone  increasing  function  of  x. 

(h)  Jj^(y)  Cl  monotone  decreasing  function  of  y. 

(c)  Ii(x),  Ji(y)  are  conatanta  - 

(d)  l2(3c)  ie  constant  over  any  subset  of 

(e)  13(3^)  Ic  constant  over  any  subset  of  . 

(f)  laC*)  -  l2(x)  is  a  monotone  increasing  function  of  i. 

(s)  JsCy)  is  constant  over  any  subset  of  Ap. 

(h)  JaCy)  is  constant  over  any  subset  of  /Lp  + 
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As  'before,  wo  now  aBcune  the  oxlatonce  of  a  solution  and  derive  its 
properties.  It  is  first  of  all  clear  that  k  never  sees  a  raise  in  some 
Interval  [o>cj  .  For,  at  x  =  0  we  have 

(5)  li(0)  =  -  1 


Consequently,  if  B  raises  a  non-n^lll  set,  13(0)  <  12(0)  ,  and  A  must 
choose  only  between  folding  and  betting  without  seeing  at  x  «  0  and 
consequently  In  some  neighborhood  of  0.  It  certainly  plausible  that 
B  raises  if  he  gets  a  card  close  to  1. 

nimilarly,  in  some  interval  '0,d  ,  B  never  sees.  At  y  =  0,  we 

have 

(6)  Ji(0)  =  dx  +  y  dx 

<12(0)  =•  (1+a')  J  dx  +  )1-H3.)  J  dx 

13(0)  =  (2a+l)  /  dx  -  (1-m)  J  dx! 

a  I* 

■’3 

Cince  B  wishes  to  minimize  and  J2(0)  >  Ji(0),  he  never  sees  A  in  some 


neighborhood  of  y  =  0. 
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There  are  now  throe  alternatives  for  A  in  acme  Initial  Interval  [p#c] 

(7)  (a)  \  always  folds  In  (0,c^ 

(h)  A  always  hets  in  [o,c 

(c)  It  is  Imniaterlal  whether  A  folds  or  bets  In 

he  combines  folding  and  betting  In  some  (as  yet  unloiown) 
proport  i  one . 

Lot  US  beg'n  by  assuming  that  (a)  Is  valid.  B  has  the  altematlvec 

(£)  (a)  B  always  folds  In 

(b)  '  B  always  raises  In  jC^d 

(c)  It  is  immaterial  whether  B  folds  or  raises  in  |0,(^  ,  and 

he  conbinos  folding  and  raising  In  socie  (as  yet  unknown) 
proportions . 


Since  Ji(y)  is  constant  and  JsCy)  is  monotone  decreasing,  If  B  begins  by 
raising  In  jo,d  ,  he  never  folds.  Consequently,  we  regard  (b)  as  least 
possible,  and  consider  first  (a)  u.nd  then  (c)  . 

Ve  have  then  as  a  first  possibility 


(9)  A; 


B: 


I  Fold 
0 


d 


1 
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I 

I 

Lot  US  show  that  d  >  c  Is  inposalhle.  Referring  to  (2),  It  Is  clear 
that  the  only  thing  that  will  force  A  to  change  fixiia  folding  to  seeing 
’  or  raising  at  c  Is  B  seeing  or  raising  in  0  <  y  <  c,  on  a  set  of  posltive- 

neasure.  If  d  >  c,  this  is  not  so,  and  hence  c  <  d.  Exactly  the  same  type 
of  reasoning  shows  that  B  only  changes  frcta  folding  to  seeing  or  raising 
if  A  hots  or  sees  in  0  <  x  <  c,  which  Is  not  true. 

Therefore,  if  a  solution  exists,  it  cannot  have  the  fom  of  (9)  . 
j  Referring  to  (7),  we  have  two  remaining  alternatives  for  A.  However, 

from  the  monotone  diameter  of  l2(x)  it  follows  that  if  A  hoglns  hy  "betting, 
I  he  never  folds  --  which  aeecns  improhahle. 

Hence,  it  Is  roasonahle  to  ti7>'  a  solution  of  the  form 


0  di  1 


Let  us  continue  our  discussion  with  the  o"baervation  that  in  some 
interval  |^Ci  ,Ca  ;  /  <  1,  there  must  he  hetting  on  A's  part.  For 

if  seeing  a  raise  is  preferable  to  hetting  without  seeing  at  Xi,  then  be¬ 
cause  of  the  monotone  behavior  of  laCx)  -  T2(x)  it  Is  preferable  for  x  >  Xi, 
eind  It  is  not  reasonable  to  suppoae  that  >.  never  just  bets,  but  always  sees 
a  raise. 


On  the  barls  of  this  i*eniark,  we  can  now  show  that  Ci  •-  di  .  as  we 
have  already  pointed  out,  the  only  thing  that  forces  A  to  change  his 
pattern  of  play  at  Ci  fixci  folding  or  betting  to  always  betting  is  betting 
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on  3*3  part  In  .  This  does  not  occur.  There  1e  still  the 

possibility  that  the  amount  of  raising  on  B'a  part  can  force  A  to  see 
raises  at  ci .  In  this  case,  there  would  he  nothing  to  force  B  to 
change  hla  strategy  at  ,  anc>.  hence  he  would  always  fold  or  raise, 
which  is  Implausihle.  Conaequently  d),  >  Ci  is  not  possible. 

Let  us  now  examine  Ci  >  di .  Precisely  the  same  type  of  argument 
shows  that  this  case  is  hl^aly  unlikely.  Hence,  we  take  Ci  =  d^,  and 
proceed  to  the  next  step. 

If  A  is  ever  to  change  over  betting,  or  seeing  and  betting,  B  must 
begin  seeing  in  (01,02)  •  Suppose  that  it  were  true  that  in  some  Interval 
[  Ci,C2j  ,  i  always  bets  and  13  always  soee.  If  C2  <  1,  it  is  clear 
that  It  ends  at  C2  aa  far  as  A  Is  concerned  only  if  B  raises  in  !_  01,02]  , 

which  is  not  so. 

Therefore  in  Ci,C2  ]  ,  it  mLXst  be  a  matter  of  indifference  to  A 

whether  he  beta  or  see^-  a  raise.  Fi'om  the  monotonlc  behavior  of  T3  -  I2, 
A"8  strategy  must  be 


(11)  A: 

and  B’s 


Fold  or  bet 


Bet  or  see 


See 


Cl 


C2 


(12) 


B: 


Fold  or  raise 


bee 


Haise 


Cl 


since  A  only  changes  over  to  seeing  raises  at  because  B  raises  in 
[c2/3]  . 
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As  yet  unlaiovn  are  the  amounts  of  folding  and  "betting  In  , 

bettiog  and  seeing  In  [ci^ca]  on  A'e  part,  and  folding  or  raising  In 
[o,Ci|  on  B*8  part.  These  unknowns  are  dotemlned  "by  the  following 
considerations . 

(13)  (a)  The  amount  of  "betting  on  A's  part  in  [  0,C].J  must  "be 

sufficient  to  make  B  start  seeing  at  ci . 

("b)  The  amount  of  seeing  raises  on  A'-s  part  In  j^Ci^CsJ  must 
"be  sufficient  to  make  B  start  raising  at  cz- 

(c)  The  amount  of  raising  on  B's  part  In  j^0,ci|  must  "be 
•ufflclent  to  make  A  start  betting  or  seeing  raises  In 

[ci,C2] 

Add  to  theae  the  facts  that 

(14)  (d)  At  X  =  0,  folding  or  betting  are  equivalent  for  A. 

(o)  At  y  =  0,  folding  or  raising  are  equivalent  for  B, 

and  we  have  five  conditions  to  determine  the  five  unknowns  cj,  02, 

If  these  five  conditions  are  consistent,  we  shall  ha''-e  a  soliition 
to  our  gams,  which  will  be  unique,  apart  frcm  the  location  of 

f  "wblch  le  of  no  importance,  and.  Ag  In  [01,02]  ,  which  is 

subject  to  same  constraints.  It  is  simplest  to  put  at  the  end  of 

[ci,C2]  , 


as  ve  shall  do. 
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¥e  tak*  A's  and  B’s  strategies  to  "be,  for  the  piurposo  of  calcul-atlon. 


(15)  A: 


,  Fold  ,  Bet  ,  See  i 

I - 1 - iii - 1 - - 1 

0  U  V  C2  1 


.  Fold  1  Raise  Gee  Raise  , 

h - < - 1 - - 1 - 1 

0  V  Cl  Co  1 


From  (c) ,  we  have  the  equation, 

(16)  -  1  =  V  -  (a+l)(l-v) 

V  -  a/a+2, 


where  a  is  the  size  of  the  het. 

Similarly,  the  other  coniltlons,  after  some  allglit  sinplificatlon, 
yield  the  conditions 

(1')  (a+2)  u  -  (3a+2)  w  =  -  2a 

(a+2)  u  -  2(l+a)  Ci  =  -  a 
v  -  2C2  «=  -  1 

(5a+2)ci  +  ac2  =  2a  +  2av  . 

FrcBi  the  equations,  it  follows  that,  for  all  values  of  u,  we  have 
the  oonsletency  condition 

(l8)  02  >  W  >  Cl  >  u 
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satisfied.  Solving  for  Ci  we  have 


(19) 


Cl 


8a^  6a.  +  ( 12a^  4  Sa)  v 

20a^  +  26a  +  3 


and  a-sll^t  calculation  shows  ai.  >  r  for  all  a  >  0.  TCaovlng  ,  we 
easily  determine  Cz,  w,  ti  from  the  other  equations  of  (!'  )  .  To  give 
some  Idea  of  the  solutions,  lot  us  take  a  =  1  and  5* 


(20)  •  Cl  C2  u  V  w 


61 

U3 

1 

4i 

a  e  X 

H 

Bl 

1 

U 

14 

a  =  5 

t 

7 

7 

1' 

The  values  for  a  =  5  arc  approximate,  e.g.,  ^  is  an  approx Init Ion  to 

331oM^* 

The  expectation  itself  may  be  calculated  and  is  given  "by 


(21)  =  -1  +  (a+1)  (c2-Oi)^  +  2(a+l)(c2-Ci)(l-C2)  +  (2afl)  (l-ca)^ 
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